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WHAT IS CLAIMED IS : 

1 . A motion controlled handheld device comprising: 

a display having a viewable surface and operable to generate a current image; 
a gesture database maintaining a plurality of gestures, each gesture defined by 
5 a motion of the device with respect to a first position of the device; 

a gesture mapping database comprising a mapping of each of the gestures to 
an associated command; 

a motion detection module operable to detect motion of the device within three 
dimensions and to identify components of the motion in relation to the viewable 
10 surface; 

a display control module having a first mode of operation and a second mode 
of operation; 

the display control module operable in the first mode of operation to monitor 
the motion of the device, to determine a location of the device resulting from the 
15 motion, and to modify the current image based on the resulting location of the device; 

the display control module operable in the second mode of operation to 
monitor the motion of the device, to track movement of the handheld device using the 
motion detection module, to compare the tracked movement with the gestures to 
identify a matching gesture, to identify one of the commands associated with the 
20 matching gesture, and to modify the current image based on the identified command; 
and 

a mode selection module operable to detect a mode selection trigger and to 
switch between the first mode of operation and the second mode of operation in 
response to detecting the mode selection trigger. 

25 

2. The motion controlled handheld device of Claim 1, wherein the mode 
selection trigger comprises a change in a state of the device. 



30 



3. The motion controlled handheld device of Claim 2, wherein the change 
in the state of the device occurs when the device switches from a first application to a 
second application. 



ATTORNEY'S DOCKET 
073338.0187 (04-50459 FLA) 



PATENT APPLICATION 



59 

4. The motion controlled handheld device of Claim 2, wherein the change 
in the state of the device occurs when the current image switches from a first image to 
a second image. 

5. The motion controlled handheld device of Claim 1, wherein the mode 
selection module switches from the first mode of operation to the second mode of 
operation in response to detecting a first mode selection trigger, and the mode 
selection module switches from the second mode of operation to the first mode of 
operation in response to detecting a second mode selection trigger different than the 
first mode selection trigger. 

6. The motion controlled handheld device of Claim 1, wherein the mode 
selection trigger comprises one of the gestures. 

7. The motion controlled handheld device of Claim 1, wherein the mode 
selection trigger comprises non-motion related input received using a user interface of 
the device. 

8. The motion controlled handheld device of Claim 1, wherein: 
the display control module has a third mode of operation; 

the display control module operable in the third mode of operation to disregard 
the motion of the device. 
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9. The motion controlled handheld device of Claim 1, further comprising: 

a first accelerometer operable to detect acceleration along a first axis; 

a second accelerometer operable to detect acceleration along a second axis, the 
second axis perpendicular to the first axis; and 

a third accelerometer operable to detect acceleration along a third axis, the 
third axis perpendicular to the first axis and perpendicular to the second axis; and 
wherein: 

the gesture database further defines each of the gestures using a sequence of 
accelerations; 

the motion detection module is further operable to detect motion of the device 
using accelerations measured by the first accelerometer, the second accelerometer, 
and the third accelerometer; and 

the display control module is further operable, in the second mode of 
operation, to match the accelerations measured by the motion detection module 
against gesture definitions in the gesture database to identify particular ones of the 
gestures. 
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10. A method for controlling a handheld device comprising: 

generating a current image on a viewable surface of the handheld device; 

maintaining a gesture database maintaining a plurality of gestures, each 
gesture defined by a motion of the device with respect to a first position of the device; 
5 maintaining a gesture mapping database comprising a mapping of each of the 

gestures to an associated command; 

detecting motion of the device within three dimensions; 

identifying components of the motion in relation to the viewable surface; 

in a first mode of operation, monitoring the motion of the device, determining 
10 a location of the device resulting from the motion, and modifying the current image 
based on the resulting location of the device; 

in a second mode of operation monitoring the motion of the device, tracking 
movement of the handheld device, comparing the tracked movement with the gestures 
to identify a matching gesture, identifying one of the commands associated with the 
15 matching gesture, and modifying the current image based on the identified command; 

detecting a mode selection trigger; and 

switching between the first mode of operation and the second mode of 
operation in response to detecting the mode selection trigger. 

20 11. The method of Claim 10, wherein the mode selection trigger comprises 

a change in a state of the device. 

12. The method of Claim 11, wherein the change in the state of the device 
occurs when the device switches from a first application to a second application. 

25 

13. The method of Claim 11, wherein the change in the state of the device 
occurs when the current image switches from a first image to a second image. 

14. The method of Claim 10, further comprising, in a third mode of 
30 operation, disregarding the motion of the device. 
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15. The method of Claim 10, wherein the gesture database further defines 
each of the gestures using a sequence of accelerations; the method further comprising: 
detecting acceleration along a first axis; 

detecting acceleration along a second axis, the second axis perpendicular to 
the first axis; and 

detecting acceleration along a third axis, the third axis perpendicular to the 
first axis and perpendicular to the second axis; 

detecting motion of the device using accelerations measured by the first 
accelerometer, the second accelerometer, and the third accelerometer; and 

matching the accelerations against gesture definitions in the gesture database 
to identify potential indicated ones of the gestures. 
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16. Logic for controlling a handheld device, the logic embodied in a 
computer readable medium and operable when executed to perform the steps of: 

generating a current image on a viewable surface of the handheld device; 

maintaining a gesture database maintaining a plurality of gestures, each 
5 gesture defined by a motion of the device with respect to a first position of the device; 

maintaining a gesture mapping database comprising a mapping of each of the 
gestures to an associated command; 

detecting motion of the device within three dimensions; 

identifying components of the motion in relation to the viewable surface; 
10 in a first mode of operation, monitoring the motion of the device, determining 

a location of the device resulting from the motion, and modifying the current image 
based on the resulting location of the device; 

in a second mode of operation monitoring the motion of the device, tracking 
movement of the handheld device, comparing the tracked movement with the gestures 
15 to identify a matching gesture, identifying one of the commands associated with the 
matching gesture, and modifying the current image based on the identified command; 

detecting a mode selection trigger; and 

switching between the first mode of operation and the second mode of 
operation in response to detecting the mode selection trigger. 

20 

17. The logic of Claim 16, wherein the mode selection trigger comprises a 
change in a state of the device. 

18. The logic of Claim 16, further operable when executed to perform the 
25 step of, in a third mode of operation, disregarding the motion of the device. 
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19. The logic of Claim 16, wherein the gesture database further defines 
each of the gestures using a sequence of accelerations; the logic further operable when 
executed to perform the steps of: 

detecting acceleration along a first axis; 

detecting acceleration along a second axis, the second axis perpendicular to 
the first axis; and 

detecting acceleration along a third axis, the third axis perpendicular to the 
first axis and perpendicular to the second axis; 

detecting motion of the device using accelerations measured by the first 
accelerometer, the second accelerometer, and the third accelerometer; and 

matching the accelerations against gesture definitions in the gesture database 
to identify potential indicated ones of the gestures. 
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20. A motion controlled handheld device comprising: 

means for generating a current image on a viewable surface of the handheld 

device; 

means for maintaining a gesture database maintaining a plurality of gestures, 
5 each gesture defined by a motion of the device with respect to a first position of the 
device; 

means for maintaining a gesture mapping database comprising a mapping of 
each of the gestures to an associated command; 

means for detecting motion of the device within three dimensions; 
10 means for identifying components of the motion in relation to the viewable 

surface; 

means for, in a first mode of operation, monitoring the motion of the device, 
determining a location of the device resulting from the motion, and modifying the 
current image based on the resulting location of the device; 
15 means for, in a second mode of operation monitoring the motion of the device, 

tracking movement of the handheld device, comparing the tracked movement with the 
gestures to identify a matching gesture, identifying one of the commands associated 
with the matching gesture, and modifying the current image based on the identified 
command; 

20 means for detecting a mode selection trigger; and 

means for switching between the first mode of operation and the second mode 
of operation in response to detecting the mode selection trigger. 



